C-E-P-S Journal I Vol.l I N“4| Year 2011 45 


Exploring the Impact of and Perceptions about 
Interactive, Self-Explaining Environments in Molecular- 
Level Animations 
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This mixed-method study investigates the effects of interactivity in ani¬ 
mations of a molecular-level process and explores perceptions about 
the animated learning tool used. Treatments were based on principles 
of cognitive psychology designed to study the main effects of treatment 
and spatial ability and their interaction. Results with students (n=i8t)) 
showed that science majors scored higher than non-science majors in 
retention measures (i.e., structure and function) but not in transfer. 
Significant main effects were found for treatment in function questions 
and spatial ability in structure questions. There was a significant interac¬ 
tion between treatment and spatial ability in structure questions. Ad¬ 
ditionally, in this study participants believed the key and the motion of 
ions and molecules were the most helpful parts of the animation. This 
study shows that students perceive the animations as being supportive 
of their learning, suggesting that animations do have a role in science 
classrooms. 
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Studija vpliva in zaznavanja interaktivnih 
samorazlagalnih okolij animacij molekularne ravni 


David A. Falvo*, Michael J. Urban in Jerry P. Suits 


Studija, izvedena po kombiniranem raziskovalnem pristopu, je ugotav- 
ljala ucinke interaktivnosti v animacijah procesa na molekularni ravni 
in zaznave, povezane s tem animacijskim ucnim orodjem. Obravnava 
ucne vsebine je temeljila na nacelih kognitivne psihologije, proucevani 
pa so bili glavni ucinki obravnave vsebine in prostorske sposobnosti 
udelezencev. Rezultati ucnega uspeha studentov (n = 189) kazejo, da 
studentje naravoslovja dosegajo visje rezultate kot studentje nenara- 
voslovnih ved pri preverjanju pomnjenja vsebine (npr. struktura in 
funkcija), ne pa tudi pri transferu znanja. Pomembni ucinki so bili ugo- 
tovljeni pri obravnavi vsebine, kadar so bila vprasanja povezana s funk- 
cijo in prostorskimi sposobnostmi, ne pa tudi pri vprasanjih, povezanih 
s strukturo. Pomembna povezava pa je med obravnavo vsebine in pros¬ 
torskimi sposobnostmi, kadar so bila vprasanja povezana s strukturo. 
Udelezenci raziskave so izrazili, da sta bila legenda ter gibanje ionov in 
molekul del animacije, ki jim je bil najbolj v pomoc pri ucenju. Studija 
ugotavlja, da studentje dojemajo animacije kot ucinkovito podporo pri 
ucenju, zato imajo pomembno vlogo pri pouku naravoslovja. 


Kljucne besede: vizualizacija, interaktivna ucna okolja, simulacije 
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Introduction 

A great deal of research has been conducted about improving students’ 
conceptual understandings of chemistry at three different representation levels 
(i.e., symbolic, particle and macroscopic levels) (Johnstone, 1993; Gabel, 2005). 
Nurrenbern and Pickering (1987), Sawrey (1990), and Nakhleh (1993) claim that 
traditional instruction tends to focus on the symbolic level (see Figure 1) in 
lectures and the macroscopic level in the laboratory. Research has led to spe¬ 
cific design principles for instructional multimedia (Chandler & Sweller, 1991; 
Mayer, 2001). Words and pictures should be used simultaneously and should be 
presented close to each other in space, while narration should be provided in 
audio format. Additionally, visualisations and symbols augment human cogni¬ 
tive capacities and help to convey concepts and information (Tversky, 2001). 




Figure 1: Image of molecules from salt dissolving in water animation. 

Historically, there have been problems in the use of animations for 
teaching. Due to the fact that animations sometimes mislead learners, caus¬ 
ing misunderstandings, there has been a history of caution about using these 
tools for teaching. Viewers often interpret movements of forms and figures in 
an animation as having causality, relationships and even intentions (Martin & 
Tversky, 2003; Tasker, 2004; Tversky, 2005). Learners assume that the colours 
and the shapes reflect the actual reality of the represented items, whereas the 
shapes and colours are, in fact, either symbolic or an idealisation of time and 
space relations. When effectively designed and used, these visualisations help 
to ensure adequate perception and comprehension in the real-world context 
of student learning (Kelly, 2005; Tasker, 2004; Tversky, 2001; Zacks & Tversky, 
2003). 
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Theoretical Framework 

Several studies of self-explaining environments show the effectiveness 
of this technique (Chi, 1996, 2000). Two studies have shown that students en¬ 
hance their mental models when they engage in defining explanations of con¬ 
cepts and processes (Chi, 2000; Chi, DeLeeuw, Chiu, & Lavancher, 1994). In 
another study, researchers found that having students explain a concept us¬ 
ing prior knowledge and cognitive reasoning improved the transfer of knowl¬ 
edge learning about the process (Atkinson, Renkl, & Merrill, 2003). Transfer of 
knowledge learning is defined as the ability to apply knowledge or skills learned 
in one context to another context. 

In addition, several learner characteristics can affect how learners per¬ 
ceive and interact with animation features, and may alter the cognitive load 
they experience (Cook, 2006). In order to study the spatial ability effect on 
learning from an animation (Schar & Zimmermann, 2007), students were clas¬ 
sified as “high spatial” or “low spatial” (Peters et al., 1995; Vandenberg & Kuse, 
1978). High-spatial learners may learn better when visual and verbal informa¬ 
tion is presented simultaneously rather than successively. Conversely, low- 
spatial learners may not benefit from this design feature (Mayer & Moreno, 
2003). Prior knowledge, a covariate in the present study, can influence the rep¬ 
resentations processed in working memory and how these representations are 
organised into coherent mental models (Cook, 2006; Schnotz, 2002). There is a 
difference between how novices and experts process information from an un¬ 
familiar visual representation. Novices focus on the surface features of their 
perceptual representation, while experts link this representation to a higher 
level that involves conceptual understanding of the material. Experts omit ir¬ 
relevant perceptual information and abstract required information from their 
relevant prior knowledge. Their long-term memory is organised and retrieved 
as well-developed schemas (Chi, Glaser, & Rees, 1982). Conversely, novices can 
be confused by visualisations because they lack the prior knowledge to distin¬ 
guish between relevant and irrelevant information (Linn, 2003). 

Research Focus 

This study investigated the interactive environments in a molecular ani¬ 
mation in a classroom setting rather than in a laboratory (Cook, 2006). The 
animation featured sodium chloride (salt) dissolving in water at the molecular 
level (Tasker et al., 2002). Students saw structures of solid sodium chloride, wa¬ 
ter molecules, and the structures that resulted when water molecules dissolved 
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the ionic structures of sodium chloride crystals. They witnessed the function of 
the sodium-chloride ionic attraction that resisted this dissolving process and 
the opposing function where the water-ion attraction overcomes this resistance 
to dissolve these ions. 

The research questions for this study were: 

• RQ 1 ) Does treatment (i.e., type of interactivity and the self-expla¬ 
ining environment used in the molecular-level animation) affect 
performance on the dependent variables, which are the post-test 
knowledge assessments? 

• RQ 2 ) Does spatial ability (high or low) affect performance on the de¬ 
pendent variables, which are the post-test knowledge assessments? 

• RQ 3 ) Is there a significant interaction between spatial ability and 
the treatment (version of the animation) that students engaged with 
during the study? 

Method 

Participants 

First-year students (n=i89) at a Midwestern university participated in 
the study. These university students were either first-year science majors or el¬ 
ementary education majors. The volunteers were randomly assigned to one of 
the treatment groups or to the control group. Participants in the qualitative 
component of the study came from the same pool of individuals. Five females 
ranging between the ages of 18 and 25 volunteered to take part in the phenom¬ 
enology with semi-structured interviews (Creswell, 1998). 

Instruments 

Students completed a demographic survey about their prior experience 
in science, as well as providing information about their age, gender and charac¬ 
teristics. Their spatial ability was assessed using the Vandenberg spatial ability 
assessment (Peters et al.,1995; Vandenberg & Kuse, 1978). Students also took a 
post-test, which was a knowledge assessment about the topic presented in the 
animation (i.e., salt dissolution in water at the molecular level). This test in¬ 
cluded structure and function questions that were used as retention measures. 
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Research design 

Prior to watching the animation of sodium chloride (salt) dissolving in 
water (Tasker et al., 2002), students viewed the components of the animation 
(e.g., see Figure 2), which were detailed on a table within the interface. The first 
version of the animation was basic, including just the visuals and narration, 
and students were able to replay the animation. In the second version, students 
had the option of pausing the animation at any time and were able to replay the 
animation if they so desired. In the third version, the animation automatically 
paused at selected points (i.e., segments) in order to create five short sections. 
At each pause point the viewer/student was prompted to either replay the pre¬ 
vious section or to move on to the next section. The viewers also had the abil¬ 
ity to, at any time, view any of the five sections in any order. The final version 
of the animation paused between each of the five sections and students were 
prompted to self-explain what they were seeing and thinking. They did this in 
a textual format. Students were allowed to revisit each section of the animation 
in any order. 

Treatment: Four versions of an interactive/self-explaining 

environment 

The animations used in this study illustrated the process of sodium chlo¬ 
ride (salt) dissolving in water at the molecular level (Tasker et al., 2002). It was 
modified with Flash to create four different versions based on cognitive princi¬ 
ples of instructional design. Students viewed the components of the animation 
(e.g., see Figure 2) before interacting with one of its four versions. 

Version 1 - Control (Animation Only) 

The animation played through from start to finish. Students were able to 
replay the animation if they so desired. 

Version 2 - Pause Button. 

Students had the option of pausing the animation at any time. Students 
were able to replay the animation if they so desired. 

Version 3 - Pause Button, and Rewind and Forward Buttons. 

The animation automatically paused at selected points (i.e., segments) 
in order to create five short sections. At each pause point, the viewer/student 
was prompted to either replay the previous section or to move on to the next 
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section. The viewer/student also had the ability to, at any time, view any of the 
five sections in any order. 

Version 4 -Pace with Self-Explaining Environment. 

The animation paused between each of the five sections and students 
were prompted to self-explain what they were seeing and thinking. They did 
this in a textual format. After submitting their self-explanation, they moved to 
the next segment of the animation. Students were allowed to revisit each sec¬ 
tion of the animation in any order. 



Figure 2: Table of key features in the animation. 

Using SPSS, a general linear model multivariate ANCOVA was used to 
determine if any of the groups performed significantly better in the post-test. 
Using the Wilks’ Lambda, the researchers explored three different aspects of 
the independent variables. The Wilks’ Lambda (alpha = .05) measures of the 
proportion of variance in the combination of dependent variables that is unac¬ 
counted for by the independent variable (the grouping variable). The analyses 
explored the effect of treatment, spatial ability and their interaction on trans¬ 
fer knowledge, understanding of structural components and understanding of 
functional components. Data regarding whether or not participants were sci¬ 
ence majors was used as a covariate in the analyses. The researchers used the 
Tukey test as a post-hoc analysis to maintain a family-wise alpha of .05. 

This research also entailed a phenomenology with semi-structured in¬ 
terviews (Creswell, 1998). All five interviewees planned to become elementary 
school teachers and ranged in age from 18 to 25. During the interviews, the 
researchers asked several questions to identify what participants found help¬ 
ful and what they liked about the animation. Also, they were asked to con¬ 
sider their diagrammatic sketch from the previous study to establish a sense of 
what they understood, or to let them enhance their sketch by making it more 
understandable. 
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Results 

Using SPSS, the MANCOVA test (Table 1) produced significant results 
for the model on the structure and function retention dependent variables but 
not for the transfer variable. For the covariant (science or non-science majors), 
overall the science majors did better on structure (p = .005) and function (p = 
.016) dependent variables (Table 2). 

Table 1: MANCOVA tests of between-subjects effects. 


Source 

Dependent 

Type III Sum of 

df 

Mean 

F 

Sig. 

Variable 

Squares 

Square 



structure 

109.310 <*> 

8 

13.664 

4.496 

.000 

Corrected Model 

function 

18.095 o» 

8 

2.262 

3.032 

.003 


transfer 

4.646 w 

8 

.581 

.840 

.569 


structure 

24.456 

1 

24.456 

8.048 

.005 

Course (co-variable) 

function 

4.383 

1 

4.383 

5.875 

.016 


transfer 

.793 

1 

.793 

1.147 

.286 


structure 

7.007 

3 

2.336 

.769 

.513 

Treatment 

function 

11.674 

3 

3.891 

5.217 

.002 


transfer 

1.321 

3 

.440 

.637 

.592 


structure 

25.073 

1 

25.073 

8.251 

.005 

Spatial ability 

function 

.167 

1 

.167 

.223 

.637 

(high or low) 

transfer 

.172 

1 

.172 

.249 

.619 

Treatment * 

structure 

56.124 

3 

18.708 

6.156 

.001 

.846 

3 

.282 

.378 

.769 

Spatial ability 

transfer 

2.568 

3 

.856 

1.238 

.297 


structure 

547.002 

180 

3.039 



Error 

function 

134.265 

180 

.746 




transfer 

124.436 

180 

.691 




structure 

2651.000 

189 




Total 

function 

953.000 

189 





transfer 

762.500 

189 





Variance explained by model for each dependent variable: 

(a) R 2 = .167 (Adjusted R 2 = . 130 ) 

(b) R 2 = .119 (Adjusted R 2 = . 080 ) 

(c) R 2 = .036 (Adjusted R 2 = -. 007 ) 
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Table 2: Significant effects of the students’ course of study, the co-variable, on 
the structure (p = .005) and function (p = .016) dependent variables. 


Tukey HSD 




Dependent variables 

Course of study (co-variable) 

N 

Structure 

Mean 

Function 

Mean. 

Science majors course 

115 

3.543 A 

2.183 A 

Non-science majors course 

74 

2.790 B 

1.865 B 

Sig. Alpha = .05 Level 

Means with the same letter (A or B) are not significantly different 

p = 

.005 

.016 


High-spatial students only scored higher than low-spatial students (p= 
.005) in structural questions (Table 3). There was a significant interaction effect 
between treatment group and spatial ability (p = .001), as depicted in the graph 
in Figure 3. 

Table 3: Significant effects of treatment groups on the function dependent 
variable (p = .002). 


Tukey HSD 


Treatment group 

N 

Function 

Mean 

Std Dev 

1: Control 

48 

2.333 A 

0.808 

3: Pause and Pace 

48 

2.271 A 

0.818 

4: Self-explain 

45 

1.867 AB 

1.014 

2: Pause 

48 

1.750 B 

0.838 

Alpha = .05 




Means with the same letter (A or B) are not significantly different 





Table 4: Significant effects of spatial ability on the structure dependent 
variable (p = .005). 


Tukey HSD 




Structure 

Spatial ability 

N 

Mean 

Std Dev 

High spatial ability 

78 

3.653 A 

2.067 

Low spatial ability 

111 

2.964 B 

1.666 

Alpha = .05 

Means with the same letter (A or B) are not significantly different 
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Figure 3: Significant interaction between treatment and spatial ability (p = 
0.001) on the structure dependent variable. 

The qualitative results in this study show that most participants believed 
the key and motion of ions and molecules were the most helpful parts of the an¬ 
imation. Students perceived the animations as being supportive of their learn¬ 
ing and believed that animations have a role in the modern science classroom. 
When questioned about what they remembered about the animation they had 
viewed prior to seeing it again, three categories emerged relating to what stu¬ 
dents remembered about the animation: molecules, chemistry and other. Three 
themes emerged related to what students felt was helpful: a key, movement and 
audio. Of the five participants, three specifically mentioned the benefit of a key. 

Many of the things that the participants liked about the animation over¬ 
lapped with things they found to be helpful. For instance, in describing things 
they liked, two participants used the words “movement” and seeing the mol¬ 
ecules “up close” (respectively). Another stated that the animation was “easier 
to understand than just somebody telling you what was going on” and “more 
entertaining.” Adding more audio to the animation was the primary suggestion. 
According to Mautone and Mayer (2001), when narration emphasises key steps 
and associated links, students “learn more deeply” from a multimedia explana¬ 
tion (p. 387). One person indicated that the animation should also have audio 
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on the first viewing, not just the last. Another person suggested using audio to 
define the charges, as in a verbal key (the animation narrator does this while the 
molecules are moving but it is not a separate entity, such as an introduction). 
One person wanted to see arrows pointing to the molecules identifying them 
within the animation. 

At the end of each interview, participants were asked how they felt the 
animation would affect them as educators. One participant responded to this 
question with, “it’s an interesting way to incorporate technology in the class¬ 
room...it’s always nice for students to hear something from another point of 
view.” Three others intimated the importance of visualisation to elementary 
students. Some literature would seem to agree. Tversky (2001) says that visu¬ 
alisations enhance cognitive competence. One of the participants said, “...kids 
are stimulated more by visuals...I think they’ll be able to relate to this way of 
teaching more than writing stuff on a chalkboard or lecturing or seeing things 
in a book.” This statement is also significant because she had only heard the 
narration, and had not actually seen the animation. She stated, “.. .1 think it’s a 
good thing. I think it gives a visual and that helps a lot of people learn, to see an 
actual visual that is a representation, instead of just hearing it.” 

Discussion 

Science majors outscored non-science majors in both retention measures, 
i.e., structure and function questions in the post-test (Table 2). The science ma¬ 
jors had been briefly exposed to salts dissolving in water previously; however, 
their prior knowledge was limited to mostly symbolic representations in lectures 
and mostly hands-on experiences with the dissolving process in the laboratory 
portion of their course. Conversely, the non-science majors had little or no prior 
knowledge of this process. This lack of prior knowledge was probably responsible 
for the latter group’s inability to organise the verbal and visual information from 
the animation into coherent mental models (Cook, 2006; Schnotz, 2002). These 
students focused on salient surface features, such as the colour of the spheres used 
to represent ions and molecules (i.e., structural features) rather than the relative 
positions of the structures, which gives meaning to chemists as domain experts. 
Apparently, the three treatment versions designed to reduce extrinsic cognitive 
load for the non-science majors could not overcome the intrinsic load imposed 
by the interrelated set of ionic and molecular structures and their associated 
functions (Chandler & Sweller, 1991). The lack of significant difference between 
science and non-science majors on transfer measures suggests that the former 
were also not able to form coherent mental models. Perhaps the science majors’ 
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unfamiliarity with the medium (they were not accustomed to viewing molecular 
animations) was a factor in preventing them from developing a conceptual un¬ 
derstanding of the dissolving process. 

Treatment produced a significant difference in the function-dependent 
variable (Table 3). The fact that none of the three treatments designed to reduce 
extrinsic load outperformed the control group in function questions suggests 
that the extrinsic load for students in these treatments remained relatively high. 
Hence, they were unable to free the cognitive capacity needed to process intrinsic 
loads of the functions involved in the dissolving process. The control and pause- 
and-pace groups both outperformed the pause group, which suggests that the 
latter may have experienced an extra extrinsic load when students had to decide 
when to “pause” as they were viewing a molecular process that had too many 
unfamiliar stimuli. 

Another explanation for these results is that the control version went 
rather quickly, so students may have replayed the animation several times in or¬ 
der to understand it. The pause button version slowed the animation somewhat, 
so students may not have replayed it multiple times. For this group, the anima¬ 
tions likely caused extrinsic cognitive load because students had to think about 
and decide when and where to pause the animation. Confirming Mayer’s (2003) 
findings, pace (breaking the animation into five segments) helped students with 
function questions. Students wondering why something happened in the anima¬ 
tion were able to go back and view the segment of the animation again to help 
them understand. The control group did just as well because students viewed the 
animation multiple times. However, because students did not have a basic cogni¬ 
tive mental model for the function components, they were not able to capitalise 
on self-explaining the concepts. It is likely that students in the self-explaining 
treatment group did not repeat the segments of the animation. Repeated viewing 
of the animation, or sections of it, may have helped students better understand 
functional components of the concept. This is an area worthy of further research. 

The study found a spatial ability effect where high spatial ability students 
outperformed their low-ability counterparts in structure questions only (Table 
4). As shown in Figure 3, the self-explanation treatment greatly enhanced the 
performance of high spatial ability students while it inhibited the learning of 
low spatial ability students. These results are in contrast to those found with the 
control group, which produced essentially no differences between high-spatial 
and low-spatial groups. This implies that the self-explanation treatment reduced 
the extrinsic cognitive load of high-spatial learners such that they were able to 
free cognitive capacity to provide a greater intrinsic load, which allowed devel¬ 
opment of a coherent mental model for the structures shown in the animation. 
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Thus, high-spatial learners gained from the simultaneous presentation of visual 
representations in the animation and verbal representations in the narration ap¬ 
parently because they had time to reflect upon their nascent mental model during 
the pause after each of the five segments. However, segmentation into meaningful 
stages was insufficient to allow the formation of mental models because students 
viewing Version 3 (pause-and-pace, which also had segmentation) did not out¬ 
perform the control group. As predicted by self-explanation literature (Chi, 1996, 
2000; Sweller, van Merrienboer, & Paas, 1998), the self-explanation group was 
prompted several times during the animation to explain the segment they had just 
viewed. This prompting allowed them to develop a deeper understanding of the 
domain (i.e., the dynamic molecular process) by forming a meaningful mental 
model for each segment. Since experts had decided where to place these pauses 
between meaningful segments, the high-spatial learners were apparently making 
the link between their perceptual representations and their conceptual represen¬ 
tations of the dissolving process. 

In sharp contrast to the above, the low-spatial learners did not ben¬ 
efit from the pause or self-explain treatments apparently because they could not 
simultaneously process the verbal/narration and visual/animation information 
given in each segment. When asked to explain what they had just viewed, they 
may have experienced an extra extrinsic cognitive load in which their knowledge 
was incomplete and their self-confidence may have been eroded. Meanwhile, 
low-spatial learners in the control group, who outperformed their counterparts 
in the self-explain group, may have replayed the entire animation several times in 
order to try to integrate verbal and visual information. The discontinuous anima¬ 
tion experienced by low-spatial learners in the other two treatment groups must 
have also adversely affected their understanding of the molecular process; that is, 
the pause button (see Figure 4) for low-spatial learners in these treatment groups 
may have induced an extrinsic cognitive load relative to the low-spatial learners 
in the control group, who experienced the continuous-play animation. 

In terms of the qualitative data, the primary finding of this study is that 
students felt the key was a critical component of the animation. Many liked the 
fact that there was movement in the animation, such as “zooming in on” and 
seeing “up close” through multiple visual angles. Colour and audio narration 
were also described as things the participants liked. Few dislikes were described. 
The comments included seeing the key before viewing the animation, and hav¬ 
ing labels that pointed to objects being described in the animation. Most of the 
students interviewed indicated that they would have liked more audio narra¬ 
tion; for example, during the first run through the animation and during the 
presentation of the key. Several participants stated that they did not foresee ever 
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being in a situation where they would use this type of animation in elementary 
education. 



«< II ► ►► Y 


Figure 4: Screen shot of the interface design of the animation including 
controls. 

Conclusions 

High-spatial learners need to pause after each meaningful segment and 
self-explain what they have just experienced in terms of visual and verbal infor¬ 
mation so they can develop effective mental models (Chi et al., 1982). Converse¬ 
ly, low-spatial learners may need animations that they can “play” continuously 
until they get an intuitive feel for the process being represented. Perhaps after 
several replays, they could try to explain to another student what they appear 
to understand in a more “holistic and flowing” manner rather than in a play- 
by-play manner filled with explicit details that could overload cognitive capac¬ 
ity. However, these results have to be interpreted cautiously because the effects 
were certainly not widespread over both retention and transfer measures. More 
research is needed to determine how to best structure and use these innovative 
tools. If animations are to live up to their promise to improve teaching and 
learning in science, researchers must continue to address how to best integrate 
these tools into science classrooms. 
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